1 



The solution of the global controllability problem for the 
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Abstract. 

The solution of the global controllability problem is obtained for a class of the triangular 
systems of O.D.E. that are not feedback linearizable. The introduced class is a generaliza- 
tion of the classes of triangular systems investigated before. The solution of the problem is 
based on the approach proposed in [TH] for the triangular systems of the Volterra equations. 
This yields the same properties of the considered class of triangular systems as those estab- 
lished in jlH] for the Volterra systems. As well as in ^H], for the current class of triangular 
systems, it is proven that there exists a family of continuous controls that solve the global 
controllability problem for the considered class and continuously depend on the initial and 
the terminal states. As well as in ^H] , this implies the global controllability of the bounded 
perturbations of the current class. In contrast with ^H], to prove the existence of the de- 
sired family of open-loop controls, we construct a family of closed-loop ones each of which 
steers the corresponding initial state into an appropriate neighborhood of an appropriate 
terminal point. 

Key words: Nonlinear control, triangular form, global controllability, feedback lin- 
earization. 

Mathematics subject classification: 93C10, 93B10, 93B11, 93B05, 93B52. 

1. Introduction and the statement of the main results. 

In this paper, we consider a control system 

x{t)=f{t,x{t),u{t)), te[to,T], (1) 

where a;GR" is the state, mgR*" is the control, and function / has the following "triangular" 
form 

/ flit,Xi,X2) \ 
f2it,Xi,X2,Xs) 



f{t,x,u) 



V f^(t,Xi,X2, ...,Xu,u) ) 



(2) 
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and 

i/GN; G R"% G R™% i = l,...,u; m G R"" = R™^+i; m=m^+i; 

'mi<mi+i, i=l,...,u; n=mi+...+m^; x=(xi, x^,)^ G R"=R™' xR™^ x. . . xR"'^ 

We assume that function / satisfies the following conditions: 

(I) /, g, and |{ are of classes C{[to, T] x R" x R™; R"), C{[to, T] x R" x R™; R"^'^), 
and C{[to,T] x R" x R'"; R'^^"^) respectively. 

(II) For each 2=1, and each (t,xi, ...,Xi)e[to,T]xK'^^x...xK'^\ the map 
fi{t,xi,...,Xi,-) is of class C"^»+i-™'+i(R™'+i;R'^0, and fi{t, Xi, Xi,R"'^+') = R™\ 

Triangular systems appeared at the earliest stage in the development of the nonlinear 
control theory - ^H] • Triangular form arose initially from a specific problem concerned with 
control of satellites (|2ZI), but in the end it became fruitful in modeling various physical 
and engineering systems (see, for instance j2], [IH], or related works jH], 

One of the causes of this was the habitual situation when the output of a given control 
system affects the input of another control system, which produces the triangular form - 
|2], [in]- This fact eventually led to the general concept of flatness |H] - the last being a 
very popular generalization of the notion of exact linearization. On the other hand, in the 
case of the cascade form, the so-called backstepping technique is employed for asymptotic 
stabilization very often - [12], [2S], [HI]- In addition, triangular systems appear naturally 
in the general exact linearization approach (see [3], ^2], ^H]; [23); which has a large number 
of applications - [T], [H], [H], [IH], [23], [21], [SO]- 

In most works cited above, the triangular form is treated as a mere specific form of the 
dynamics of a feedback linearizable system however. (The exception is the papers where 
the main objective is only the design of stabilizers without finding the appropriate states 
coordinates - [7] , [T^], [SI], [SH])- More precisely, the standard requirement for the triangular 
form Q is that the conditions l^f^l 7^ 0, z = l,...,z/ (xjGR^), or, even, | |>Q>0, 
i = hold. This condition implies the feedback equivalence of the system to the 

linear canonical form ij = Zj+i, i=l, u—l, = v; and, conversely, if this condition does 
not hold, then the system may be not feedback linearizable in the corresponding domain 
(see example 1.1 below). 

The case when these conditions do not hold, which is called the "singular" case, is 
considered in works [3], [22]- In these papers, the triangular systems are studied provided 
that the set of the regular points (i.e., the set of all x such that |§^r^| 7^ 0, i=l, z/— 1,) 
is open and dense in the state space however. This may be not the case in some simple 
examples (see again example 1.1 which is given below). That is why, as it is concluded in 
[3], the singular case requires further investigation. 

On the other hand, most results concerned with the concept of feedback linearization 
are essentially local (again, as the exception, we can mention work [2n] which we are going 
to generalize in some ways). This is another motive for introducing new classes of the 
triangular systems that are wider than those investigated before [13], [IE], [21], [3]- 

Therefore, our main goal is to find a generalization, of the triangular form, that can be 
studied globally. The class of triangular systems that is defined by our conditions (I), (II) 
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is such a generalization. In this paper, we restrict our study to the solution of the global 
controllability problem for this class. For this, we use the approach that was developed in 
|17j . [TH] for the triangular systems of the Volterra equations. As the outcome, we obtain 
that the formulation of the main theorems are the same both in the current work and in 
[IH] (but, of course, the classes of the control systems that are considered in (TH] and in the 
current work differ essentially). 

Like in ^Hl , for (Q) , we construct a family of open-loop continuous controls parametrized 
by the initial and the terminal states such that every element of this family steers the 
corresponding initial state to the corresponding terminal one and continuously depends on 
the initial and the terminal states (theorem 1.1.). This automatically yields some kind of 
robustness; in particular, we obtain the global controllability of the bounded perturbations 
of system (theorem 1.2) 

Following JHl, we consider a perturbation of system of the form 

x{t) = f{t,x{t),u{t)) + h{t,x{t),u{t)), tG[to,T], (3) 

where h satisfies the conditions: 

(III) . /ieC([to,T]xR"xR'";R"), and for each compact set QcR"xR"*, there exists 
Lq>0 such that, for each tE[to,T], each {x^,u^)eQ, and each (x^,m^)G(5, we obtain: 

\h{t,x^,u^) - /l(t,X^M^)| < Lq{\x^ - x^\ + - u^\). 

(IV) . There exists H>0 such that, for each {t,x,u)e[tQ,T]xK'^xW^, we have: 
\h{t,x,u)\<H. 

Throughout the paper, for each x^gR", each u{-)ELoo{[to,T]; R™), and each TE[to,T], 
hjt\-^ x(t, T, x^, u{-)) we denote the trajectory, of system ((H), that is defined by the control 
n(-) and by the initial condition x{t)=x^ on some maximal subinterval JiG[to,T], tEJi. 
The main results of the current work are the following theorems 1.1-1.3. 

Theorem 1.1. Assume that, for system function f has triangular form (0) and sat- 
isfies conditions (I) and (II). Then, there exists a family of controls {M(a;0,xT)(')}(xO 2:T)eR"xR" 
such that the map given by (x°,x-^) t-^ U(x",xT){') ^'s of class C(R"' x R"; C([to, 7"]; R™)), 
and, for every (x°, x"^) G R" x R", the trajectory ty-^x{t, tg, a;", U(^.o .j^^t)(-)) is defined for all 
te[to,T], and x{T,to,x^,U(^^o^^T){-)) = x^. 

Theorem 1.2. Assume that, for system (CJ), function f has triangular form (0), 
satisfies (I), (II), and satisfies the global Lipschitz condition w.r.t. x and u, i.e., there exists 
L> such that, for each te[to,T], each (xS m^)gR"xR'", and each (x^m^) g R" x R™, 
we have 

|/(t, x\ u') - fit, x\ u')\ < L{\x^ - x^l + - u^l). 

Suppose that function h satisfies (III) and (IV). Then system (0) is globally controllable in 
time [to, T] by means of controls from class C{[to,T]; R"*). 

Theorem 1.3. Assume that f has triangular form (0) and satisfies (I), (II). Then sys- 
tem |ip is globally controllable in time [to, T] by means of controls from class C{[to,T]; H"^). 
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Example 1.1. Consider the system 

X2{t) = U[t) 

where (xi, X2)"^€R^ xR^=R^ is the state, mgR^ is the control, T > is an arbitrary fixed 
number, and g{-) is given by 

y (y - 2) sm(y - 2) if ?/ > 2 

It is clear that system (0]) has triangular form Q and satisfies conditions (I) and (II). 

Let us prove that (@)) is not globally feedback equivalent to the canonical system, i.e., 
there are no functions 0i(t,xi,X2), (t>2{t,xi,X2), and 03(i(;, xi, X2, m), of class ^ such that 
(A) for each te[0,T], the maps (xi, X2)^^-^(0l(t, xi, X2), 02(i^, X2))"^ and (xi,X2,'u)"^ ^ 
{(pi{t, Xi, X2) , (l>2it, Xi, X2) , tpsit^ ^1^ ^2, u))^ are diffeomorphisms of R^ onto R^, and of R^ 
onto R^ respectively, and (B) if (xi(-), X2(-))"^ is a trajectory of (jH) with some control u{-), 
then the functions f (■) and -22(-))^ ^^at are defined by 

Zl(t) = (/)i(t,Xi(t),X2(t)) 

Z2{t) = Mt,Mt),X2{t)) tG[0,T], (6) 

= 03(t,Xi(t),X2(t),M(t)), 

satisfy 

tG[0,T], (7) 




and conversely, if {zi{-) , Z2{-)) is a trajectory of system ((Tj) with some control f(-), then 
the functions m(-) and (xi(-), X2(-))'^ that are defined by (jH)) satisfy (jD). 

Assume the converse, i.e., that such a global feedback transformation does ex- 
ist. Put: xl=X2=u*=0. Let (a;i(-), X2(-))^ be the trajectory, of (jH), that is defined 
by the control u(t)=u*, tG[0,T], and by the initial condition (xi(0), X2(0)) ={xl,X2) ■ 
Then {xi{t),X2{t)f={xl,xlf=0eR^ for all te[0,T]. By {zi{-) , Z2{-)f and denote 
the trajectory and the control, of system (|7j), that are defined by ©. Put: zl = 
0i(O,x*,X2), Z2 = 02(O,x*,X2). Then, it is clear that the controls fi(t):=^ — ^ and 
V2it)= - |+||, te[0, T], steer the origin (0, ofeR^ into vectors ei=(l, 0)^ and e2=(0, 1)^ 
respectively in time [0,T] w.r.t. (0). For each /i=(/ii, /i2)^GR^, by 'y(^^,^2)(') de- 
note the control v^^^^^^){-)=v{-)+fiiVi{-)+fi2V2{-), and let {zi{fii, fi2, ■), Z2{^ii, fi2, ■))'^ be 
the trajectory, of ((Tj), defined by the control f(;xi,^2)(') and by the initial condition 
(zi(/ii,/i2,0),22(/ii,/U2,0)) = (2;*,^;). Let /i2, a;2(/Ui, /i2, O)^ and M(^i,^2)(") be de- 

fined by 

Zi{fii,fi2,t) = 4>i(t,Xi{^i,fi2,t),X2{fii,fi2,t)), i = 1,2; 
^(w,M2)W = 03(i,a;i(/ii,/i2,t),a;2(/ii,/i2,t),M(/.i,A.2)(t)); t e [0,T]. (8) 
Then, since (jZ)) is a linear system, we obtain that 



{Zi{fii, ^2,T), Z2{fil, H2,T)) = {Zi{T) + fii,Z2{T) + H2) , 
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i.e., the map {fii, fi2)'^^-*{zi{fii, fi2,T), Z2{fii, fi2,T))^ is a diffeomorphism of onto 
R^; therefore, since (0) satisfies condition (A), from (jSI), it follows that {^1,^2)^ ^ 
{xi{fii, fi2,T),X2{fii, fJ'2,T))'^ is (in particular) a diffeomorphism of some neighborhood of 
(/ii,/i2) =OgR^ onto some neighborhood of ( 

On the other hand, from (jSI), it follows that the maps {^11,^-2)^ ^ '"{/ii,M2)(') 
and (/ii,yU2)"^ ^ fi2, ■)j^2(yf^i, ■))^ are of classes C(R^; C([0, T]; R-^)) and 

C(R^; C([0,T]; R^)) respectively; hence, taking into account that 

(a;i(0,0,t),X2(0,0,t)f=(xt,x;f=0eR2, M(o,o)(t)=M*=0, te[0,T], 

we get the existence of a neighborhood B of point OgR^ such that, for each (/ii, /i2)"^G-B, 
we obtain 

-2 < X2{fii,fi2,t) <2 for alHG[0,T]. (9) 

By the construction, (xi{iii, 1^2, ■), X2{lJ'i, H2, ■))^ is the trajectory, of (jl}, defined by the 
control M(/ii,/i2)(') a^iid by the initial condition /i2, 0)=a;2(/ii, /i25 0)=0; therefore, from 

©, and from (0), we get: /i2, t) = whenever tG[0,T] and (/ii, /i2)^G-B. Hence, the 

rank of the map (/ii, fi2)^^{xi{fii, (^2, T),X2{^J'i, /i2, T))'^ is less than 2 at each (/xi, fi2) G B. 
This contradicts the fact that this map is a local diffeomorphism at = and proves that 
system (jU is not globally feedback equivalent to system (|7j). 

Let us remark that, system Q satisfies conditions (I), (II) so that we can apply the- 
orems 1.1, 1.3 to (Q. On the other hand, since g{-) is given by system does not 
satisfy the global Lipschitz condition, and, therefore, we can not apply theorem 1.2 to the 
bounded perturbations of (jlj). However, if g{-) were given by 

( ) = h '^y-'^ 

^^^^ \ ln\y - 1) X sin{ln(?/ - 1)} if y > 2, 

then we could apply all our theorems 1.1-1.3 to system (j3)), but would not be feedback 
equivalent to ((Zj) as well. 

Before proving theorems 1.1-1.3, we must stress the following three main points. 

Remark 1.1. The proof of theorem 1.2 follows from theorem 1.1 and from the Brouwer 
fixed-point theorem. We omitt the argument, which is the same as in JHj, (see sect. 2). It is 
clear that theorem 1.3 is a corollary of theorem 1.1 as well. Therefore, the proof of theorem 
1.1 is the only goal of the next sections of the current issue. 

Remark 1.2. As we mention above, the proof of theorem 1.1 is based on the same 
approach as in ^H]- However, one encounters the following two problems on this way. 

A) Condition (ii) from ^H] (see sect.l) implies the complete controllability of the 
linearized control system (system (24) in ^^) around every trajectory of the triangu- 
lar system. In other words, for the class of systems considered in ^H], the input-output 
map u{-) ^ x{T,to,x^,u{-)) is of the full rank at u{-) whatever x*^ and u{-) are cho- 
sen. Condition (II) from the current work does not ensure the same property for our 
system (P). For instance, if a trajectory of system ^ from our example 1.1 lies in the set 
{{xi,X2)'^ G R^l X2 < 2}, then the linearized control system around such a trajectory will 
not be completely controllable. 
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B) For the triangular systems from jTH] , conditions (ii) and (iii) guarantee much more 
than only the existence of the solution for the last integral equation of the triangular system 
w.r.t. the control (see Eq.(8) from ^Hl); the obtained controls continuously depend on the 
corresponding parameter x (w.r.t the metric of C{\tQ,T]]'R})). And again, condition (II) 
from the current work does not imply any similar property for (Q) . Assume, for simplicity, 
that mi=l, i=l,...,z/; fix some z=l,...,z/, and let (C? O^^i(C) ^) ')) J=l;---)^) be arbitrary 
maps of class C(R* x R*; C^([tQ,T]; IV-)). Given (^,^)gR*xR*, find a measurable function 
'^(C,5)(') ^'^'^^ that 

Xi{C,^,t) = /i(t,xi(C,^,t),...,a;i(C,^,t),f(C,c)W) whenever te[to,T]. 

Although the existence of such f(^,^)(-) can be proved via a slight modification of the well- 
known Filippov lemma (see the obtained map (C? 0'^'^(C,o(') discontinuous 
even as a map to Li{[to,T]; R™''+i). 

Remark 1.3. To cope with the above-mentioned problem B), we prove lemma 3.4 
(see sect. 3), which is the main difference between the current proof and that of |18|. We 
emphasize that, although our original problem is to obtain appropriate open- loop controls, 
we construct a feedback law while proving lemma 3.4. - see and (ffH|l . This construction 
not only yields the desired robustness properties of the obtained controls but also is a 
method for solving the problem of global stabilization for our class of systems. 



2. The reduction of the main result to the problem of the controllability with 
boundary conditions imposed on controls. 

Choose arbitrary tiGjto? T[, and a;]|GR™^. From (II), and from the Sard theorem we get 
(by induction on i=l, z/) the existence of z*&TV^^ and x*_^]^gR'"'+^, i=l, such that 

dfi 

z* = Mti,xl,...,x*^^), rank— ^(ti,x*,...,x*+i) = mi, i=l,...,u. (10) 

In addition, we introduce the following notation 

m*:=x:+iGR'"-+^=R'"; x*: = ixl,...,xlfeR''=K^'x...xR"'^ (11) 

To prove theorem 1.1, it is sufficient to prove the following statement. 

Theorem 2.1. Assume that, for system function f has triangular form (0) and 
satisfies (I), (II). Choose tie]to,T[, z*eW^\ x*eR'^% i=l,...,u, and xl^-^=u*eR"' such 
that iflDj) . ifTI)) hold. Then there exist families of controls {UxT{-)}^T^^n and {uxo{-)}^o^ji^n 
defined on [ti,T] and [to,^i] respectively such that: 

1) The maps x'^^Uxt{-) and s>-u^o(-) are of classes C(R"; C([ti, T]; R™)) and 
C(R"; C([to, ti]; R™)) respectively 

2) For each x^eR"', and each x'^eR^, we have: u^o (ti)=Ux,T iti)=u* =xl^-^^. 

3) For each x^eR^, and each X"^gR", the trajectories t ^ x(t, ti, x*, M2,t(-)) and 
t I— > x(t, ti, X*, 'U^o(-)) are defined for all t in [ti,T] and [tc^i] respectively, and 

x{T, ti, X*,Uxt{-))=X^, x(to, ti, X% M^o(-))=X°. 
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Indeed, if theorem 2.1 is proven, then, the family {w(a;0 ,^.t)(-)}/^o ^rjgRnxRn given by 




if t G [to,ti[ 
if te [ti,T], 



for all (x°,x^)eR" xR" 



satisfies theorem 1.1. On the other hand, to prove theorem 2.1, we need to construct only 
one of the two families of controls (for instance {UxT{-)}^T^^n)', the construction for the 
other is similar. The existence of the desired {wa,T(-)}^.Tgj^„ immediately follows from the 
next statement (theorem 2.2), which is formulated after the following notation. 
Let p be in {1, z/}. By definition, put 



k = nil + ••• + TTLj^ 



R 



mi 



X 



X R™p 



"p; y 

z* = izl,...,z;f eR', J:=[ti,T], 
and consider the following k - dimensional control system 

y{t)=^{t,y{t),v{t)), teJ=[h,T], 

where y={xi, a;p)'^eR''=R™^ x...xR"'p is the state, v e R'^p+i is the control, and 



:i2i 



(13) 



/ /i(t,Xi,X2) 
f2{t,Xi,X2,X3] 



\ 



\ fp{t,Xi,X2,...,Xp,v) ) 



(14) 



for all (t,?/,f)=(t,a:i, ...,Xp,T;)GJxR'^i+--+™pxR™p+i. For each yGR'', each tGJ, and each 
v{-)&Lrxi{J] R'"''+^), let ti^yit, r, y, t>(-)) be the trajectory, of system (fT^ . that is defined by 
the control f (■) and by the initial condition ?/(r, r, y, f (■)) = y on some maximal subinterval 
Ji G J (where r G Ji). If, for all t & J, we have v{t) = v, where v G TV^p+^ , then, we 
denote this trajectory hj t y{t, r, y, v). 

Theorem 2.2. Assume that f has triangular form (0) and satisfies (I), (II), and 
let tie]to,T[, a;*GR", x*+i=m*gR"', and z*gR™% i=l,...,u, be such that C^), |IIp hold. 
Choose any 2;*_,_^gR™'''+^. For some arbitrary pG{l, z/}, define k, y*&TV^, z*gR'^, and J 
by 113), arid consider system (fl^) witii giveri by ifTij) . Suppose that there exists a family 
{y{^, ■)=(a;i(^, ■), ...,Xp{C,, ■))'^}^^iik of functions of J to TV' such that: 

1) For each i=l, ...,p, the map ^^Xi{C,, ■) is of class C(R'^; C^(J; R™*)). 

2) For each ^ G R'^, we have: Xi{^,t) = fi{t,xi{C,,t), Xi+i(^, t)) whenever l<i<p—l, 
zGN, teJ. 

3) For each ^ G R^ we obtain: y{^,ti)=y\ ?/(^,T)=^, Xp{^,ti)=z;=fp{ti,y*,x;^i). 
Then, for system there exists a family of controls {^^(?,/3)(-)}(5 /3)eR'=xR'>+i ^^^^ 

that: 

4) The map (^, /3)^%/3)(-) is of class C(R'=xR"^f+i; Ci( J; R"^p+i)). 

5) For each (^, /?)gR''xR™j'+i, weobtain: %,^)(T)=/5, %,;3)(ti)=a;;+i, |%/3)(ti)=2;;+i. 
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6) For each G R'' x K'^p+\ the trajectory t\-^y{t,ti,y* ,V(^^^i3){-)) is defined for all 

teJ, ai3dy(T,ti,?/*,%^)(-))=^. 

Let us remark that, if a family of controls {^(5./3)(')}(g /3)eR'=xR™p+i satisfies conditions 
4) and 6) of theorem 2.2, then the map that assigns to each (^, j3)EH'^xTV^p+^ the trajectory 
t\-^yit,ti,y*,V(^^^/3){-)) is of class C(R''xR'^p+i; C^(J; R'')). Therefore, theorem 2.2 means 
that, if, for k - dimensional system (fT^ . there exists a family {y{^, OI^gr'' ^^^'^ ^^^^ 
hold, then the same is true for the fc + mp+i - dimensional dynamical extension, of (jl3p . that 
is determined by For p=l and k=mi, the construction of Ol^gRfc that satisfies 
l)-3) is trivial: condition 2) consists of p— 1=0 equalities; therefore, Ol^gR^i given, 
for instance, by 

y{U)=x,{^,t)=xl^t-t,)zl+ ^l^^'\^ {^-xl-{T-t^)zl), eeR'=R'"S teJ, 

satisfies l)-3). Using the induction on p=l, z/ and theorem 2.2, for p=i', and k=n, we 
get the existence of a family of controls /3)eR"xR™ ^^'^'^ ^^^^^ conditions 4)-6) 

of theorem 2.2 hold for k=n; m=mj,+i=mp+i. Fix an arbitrary /5gR™. Then, the family 
of controls {UxT {■)} given by UxT{t):=V(^^/3){t), x^gR", tEJ, satisfies the conditions 
of theorem 2.1. The existence of the other family {Si,.o(-)}^.ogj^„ can be proved similarely. 
Thus, the main results of the paper (theorems 1.1, 2.1, as well as 1.2 and 1.3) follow directly 
from theorem 2.2 whose proof is the main objective of our next efforts. 

Throughout the paper, for each r>0, and each yEH}, by Br{y) we denote the open ball 
Br{y):={riElV'\ \ri—y\<r}, and, for A C R'^, by A we denote the closure of A. In addition, 
we put Z+ := N[J{0}, and for r G R, by [r] we denote /c G Z such that k<r < k+1. 



3. Proof of theorem 2.2. 

Let p be in {l,...,i/}. Assume that {|/(^, Ol^eRfc satisfies conditions l)-3) of theorem 

2.2. 

Let Xi=:(xi,i, ...,Xi,mJ'^GR'"^ and fi{t,x,u)=:{fl{t,x,u), fl^*{t,x,u))'^ be the co- 
ordinate representations of vectors XiGR™"* and /jGR"^' for 2=l,...,i/+l and i=l,...,i> 
respectively. For every 2=1,. ..,z/, every l<ji < ... < jnn^^i+i, and every (t,y,v) in 
[to,T]x'R'' xR,'^'+\ by Mj^ {t,y,v) denote the matrix ( gf.^i {t, y, v) j (generated 

by the columns, of the matrix , numbered by ji, j2, ■■■,jmi)- Using (fTUl) and the implicit 
function theorem, we get the existence of neig hborhoods Ei^^y.,^.* c[to,T]xR'^xR™f+i and 
Gji,y*,2*c[to, 7']xR''xR'^f of points (ti,?/*,x*^J and {ti,y*,z*) respectively and the exis- 
tence of p sequences of indices 1 < < . . . < jmX'^) — "^j+i? ^ ^ {1; such that, 
first, 

\/{t,y,v)eEt^,y*,,;^^ VzG{l,...,p} detMj^(,)_^,^^(,)(t,y,t;)^0, (15) 

and, second, there exists a map {t,y,Zp+i) t-^ (f){t,y, Zp^i) of class C(G'(^^y*^2*; R^^+i) such 
that 1^ and ^^'^ are continuous on G+, , and 

,y*,z*)C |(Xp+i^l, . . . , Xp+i^mp+i) GR ''+^1 VjG{1, mp+i} 
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(j i {ji(p),--,jmp(p)}) ^ (2;p+ij = ; 0(ti,?/*,z;)=x;+i; 

\/{t,y,Zp) e Gt,,y*,z; {t,y,(f){t,y,Zp)) E E^^^j^.,^.^^; (16) 

V(t, 2p) e Gt^^y*^^* fp{t, y, (j){t, y, Zp)) = Zp. (17) 

Let us prove the existence of cr(-)GC(R'^; ]0, T— ti[) such that 

VeGR'^ VsG [ti,ti + a(0] (s,y(e,s),x,(e,s))GGi„,.,,.. (18) 

For this, it suffices to prove the existence of {5i}'^^ c]0,T— ti[ such that, for each ZgN, 
each ^gR'^ such that |^|</, and each sG[ti, we have: (s, ?/(,^, s), Xp(,^, s)) G Gt^^y*^z*- 

Then, without loss of generahty, we may assume that < 5iJ^i<5i<T—ti for all /gN, and 
then the continuous function (t(-) given by 



+ (%i+i]+i - 5[i5i+i])(iei - wm if lei ^ z+ 



^(0 = 

satisfies flTH|) . Assume the converse (i.e. that such {5;} does not exist). Then, there exist 
/qGN, a sequence {^g}^iC-Bz(,(0)cR'^, and a sequence {(J^}^]^ C]0,T— ti[ such that 5q^0 
as g— > + oo, and for each gGN we have: 



{(s,y(e„s),Xp(e„s))GJxR^xR'"''| sG[ti,ti+5,]} 



Since l^^l < Zq for all G N, we obtain that there exist ^gR'^ (|^|<Zo) and a subse- 
quence {iq^}'^^i of sequence {■Cgj^i such that ^^^^^ as T^oo. Without loss of gener- 
ality, we may assume that >^ as g^O. For we obtain from conditions 1) and 3) of 
theorem 2.2 that there exists (5(^)g]0, T— ti[ such that, for each sG[ti, ti+5(.^)], we have 
(s, ?/(^, s), Xp(^, s))gGji,j;*,2*. Then, from condition 1) of theorem 2.2, we get the existence 
of p>0 such that, for each ^G-Bp(^), the inclusion {s,y{^, s),Xp{^, s))EGt^^y*^z* holds for all 
sG[ti, ^1+5(0] as well. In particular, this is true for ^ = whenever q > qo (where qoEN is 
any number such that for all q>qo we get ^gG-Bp(^)). This contradicts the choice of {6q}'^^ 
and {^q}'^i and proves the existence of o-(-)gC(R'^; ]0, T— ti[) such that (fTH)) holds. 
Consider the family oi k - dimensional control systems 

m=^it, y{^, t), <f){t, y{^, t),xp{^, t)))z{t)+^{t, y(e, t), (Pit, y{^, t), ip(e, t)))w{t), 

te[h,t,+aiO] (19) 

where ^gR'^ is the state, wgR™*'+^ is the control, and ^ G R'^ is the parameter of the family. 
From (fT3j) . (fT^ . (fTH|) . and from lemma 4.1, we get the existence of k families of controls 
■)}gGR'=' i=l' ^' such that 

wj{;-) G C({(e,t)GR'=xJ| ti<t<ti+a(0};R"^-+^), 

dwj 



dt 



eGm,t)eR''xJ\ ti<t<ti+a(0}; R'"^+^), j=l,...,fc, (20) 
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and such that for each j=l,...,k, and each ^ G R'^, the control Wj{^,-) is defined on 



[tuti+a{^)], steers OeR'= into ej = {0, 0, 1, 0, 0)^eR'' (the j - th unit vector of R'^) i 
time [ti,ti+a{C,)] with respect to (fTUI) . and satisfies the boundary conditions 

7i;,(e,ti+a(0)=OGR'"^+\ (21) 

For each A=(Ai, Afc)^GR^, and each ^gR'^, let vx{C,,-) be the control defined on 
[ti,h+a{0] by 

k 

Vx{^,t)=<j){t,y{^,t),Xp{^,t))+J2^jWj{^,t), for all te[h,h+aiO]- (22) 

For each ^gR'^, and each AgR'^ such that t\-^y(t,ti,y* ,v\{C,, ■)) is defined for all 
tG[ti,ti+a(0], we put, by definition, yx{^,t):=y{t,ti,y* ,vxi^, ■)) whenever tG[ti, ti+a(0], 
and, then, for each /i=(/ii, /ifc)"^GR'^, by z^^x{(,, ■) we denote the trajectory, of the system 

i(t)=|^(t, yx{^, t),vx{^, t))z{t)+^{t, yx{^, t),vx{^, t))w{t), te[h, ti+cr(0], (23) 

with states ^gR'^, and controls w&TV^p+'^ , that is defined on [ti,ti+a{^)] by the control 

k 

■)= J2 f^j'^ji^^ and by the initial condition z^^x{C,,ti)=OEH^ . 
i=i 

Define the families {$(^, ■)}^gpj^fc and {\l/(^, -, ■)}^gj^fe of maps from R*^ and R'^xR'^ 
respectively to R*^ as follows: for each ^GR'^, each /xGR^, and each AgR*^ such that 
the trajectory t\-^y(t,ti,y* ,vx{^, ■)) is defined for all t&[ti,ti+a{^)], by definition, put: 
^{C,, X)=yx{C,, ti+a \l/(^, /i, A)=z^^a(^5 ^i+cr(0)- (Note that, by the construction, from 
(IT7|l . (UHl), (ES), and from condition 2) of theorem 2.2, we get yx{^,t)\x=o=y{,^,t), 
tG[ti,ti+a(0], and, therefore, $(^, 0)=?/(^, ti+(T(0) for all ^gR^). 

Lemma 3.1. 1) There exists a function £:(-)gC(R^; ]0, +oo[) such that, for each (^, A) 
in n:={(^, A)gR''xR''| AG-Be(5)(0)}, the trajectory t\-^y{t,ti,y*,Vx{C,, ■)) is defined for all 
tG[ti, ti+(T(^)], and, therefore, $(^, A) and \l/(^, ■, A) are well defined. 

2) For each ^gR'^, the map Ai-^$(^, A) is differentiable for all AG-Be(^)(0), and 



m 



5$ i, 
— (e,A)/i = ^(e,/i,A) whenever Ag5,(5)(0), ^gR^ 



3) The maps (^, A)h^$(^, A) and (^, A)h^||(^, A) are of classes C(n; R'^) and 
C(Il; K''^'') respectively. 

Lemma 3.1 immediately follows from the well-known theorems on the differentiability 
of the solution of the Cauchy problem w.r.t. a parameter. 

Using the definition of {wj{^, Ol^gR*: and lemma 3.1, for each ^gR'^, and each j=l, k, 
we get: \l/(^, Cj, \)\x=o=ej, i.e., |f (C, 0)=/, where /gR'^^'^ is the identity matrix. Fix some 
p>0 such that each matrix A&H!'^^ that satisfies the inequality || A—I\\<2p is positive 
definite. 
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Lemma 3.2. There exist functions ei{-) and e2{-), of class C(R'^; ]0, +oo[), such that 
for each CgR'^ we have: 

eiiO < ^eiO (24) 
'dX 



VAGi?,,(5)(0) ||_(^,A)-/||<p (25) 



5e.(o(y(e,ti + ^(0)) C <l>(e,i?,,(5)(0)). (26) 

The proof of lemma 3.2, which is omitted, is the same as the proof of lemma 3.4 from 
[TH]. The construction of ei(-) and e2{-) is similar to that of the continuous function cr(-) 
introduced above. 

Along with system (fT^ . we consider the following k - dimensional control system 

Xi{t) = f^{t,Xi{t),...,Xi+i{t)), l<i<p-l, ieN; ^^^^ 
Xp{t) =uj(t), 

with states y=ixi, Xp)^GR"^^+-+™'f=R'' and controls cjgR""". 

For each yGR'^, each tgJ, and each ci;(-)gLoo(^; R™^), by t\-^z{t,T,y,uj{-)) we denote 
the trajectory, of (jTTj) . that is defined by the control ci;(-) and by the initial condition 
z{T,T,y,uj{-))=y on some maximal subinterval JiCJ (tGJi). 

Let us remark that, from conditions l)-3) of theorem 2.2, and from the definition of 
{^{^^ OlgeRfc. we obtain: 

VeGR'^ VtGJ i/(e,t)=^(t,T,e,x,(e,-)); and ^^,0)=z{t,+a{^),T,^,Xpi^,-)). (28) 

Lemma 3.3. There exists 5{-) G C(R'^; ]0, +oo[) such that, for each ^ G R'^, and 
each uj{-) G Loq{J]IV^^) that satisfies \\uj{-) — ip(^, ■)IIloo(JR'"p) ^ ^iO^ trajectory 
t\-^z(t,T,C,,u!{-)) is defined for all t&J, and satisfies the conditions 

WteJ \z{t,T,^,u;{-)yy{U)\ < (29) 
|z(ti + a(O,T,e,c.(-))-$(e,0)| < (30) 

Proof of lemma 3.3. Like in the construction of cr(-), it suffices to prove the ex- 
istence of {Sr}'^i (0 < 6r+i < Sr for all rGN) such that, for each rGN, each ^EBr{0), 
and each u{-)&Loo{J','R"^''), the inequality ||t^(-)~^p(^5 ■)IIl^(jr'"p) < implies that 
ti^z(t,T,^,u!{-)) is defined for all tGJ, and 

VtGJ |2;(t,T,e,cu(-))-^(t,T,e,Xp(e,-))l < 7 min e^jQ. 

The existence of such {6r}'^i follows from standard arguments based on the Gronwall- 
Bellman lemma. The proof of lemma 3.3 is complete. 
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Lemma 3.4. Let family Ol^gRfc be such that conditions l)-3) of theorem 2.2 
hold. Then, for system ifl^) . there exist a function M(-) G C(R^; ]0, +oo[) and a family 
{v{C,, Ol^eRfe of controls defined on J such that the following conditions hold: 

1) For each ^gR'^, the control v{C,,-) is a piecewise constant function on J, and the 
map ^^v{^, ■) is of class C(R'=; Li(J; R^^+i)). 

2) For each ^gR'^, the trajectory t\-*y(t, T, ^, v{^, ■)) is defined for all tEJ, and 

yteJ - Uit,yit,T,^,v{^,-)),v{^,t))\ < 5(0. 

3) For each .^gR^, we have: \\ v{^, ■)llLoo(J;R'"f+i)— 



3.1. Proof of lemma 3.4. 

Let {Rg}'^i C N be an arbitrary sequence such that -Ri=l, Rg+i>Rq+l, gGN. Let us 
recall that for each ?7GR'^, and each R>0 by Br{vi) we denote the set {CgR'^I \C,—rj\<R}. 
By definition, put 



1 

2cei?fl_(0) 



5q=- min (5(0, 



Mq= maj^ II y(0 OllcfJ-Rfe) + max £2(0+1, gGN; (31) 

i^, = {yGR'^| |1/|<MJCR^ rf, = M,+2 + l, geN; (32) 
Wq = {zp G R™-| \zp\ < max || ip(0 OllwR'"-) + ^ ^^N; (33) 



Si = 5^,(0); S,+i = fiR,^,(0)\fi^,(0), gGN; (34) 
E,=B^xJxK,; = E,|J ((^^,+,(0) \ 3^,(0)) x J x iT.+i) , gGN; (35) 

oo 

£^ = U (36) 
Fix an arbitrary gGN. For each A^gN, by definition, put: 

A'^= |(t,y,Zp)GJxK,+ixR'"-| 3t;GR'"''+^ (|U|<iV) A (|;2p-/p(t, 1/,I;)|<|)| . 

Since fp is continuous, each (A^ G N) is an open set of the metric space JxK^+ixR"^p 
equipped with the usual metric generated by the norm of RxR'^xR'"''. In addition, 
JxKq+ixWq is a compact set of this metric space, and A^cA^_^]^ for all A^gN. Then, 

oo 

since J x Kq+i x Wq C |J A^, from (11), we get the existence of A''o(g)GN such that 

N=l 

J X Kq+ixWqCA'j^^f^^y By definition, put: 

Uq = {t;GR™^+i| |t;| < No{q)}. (37) 

Thus, for each gGN, we get the existence of the compact set Uq defined by flHTj) such that 
for every {t,y, Zp)GJxKqj^ixWq there exists fGt/q such that \zp — fp{t,y,v)\ < ^. 
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In addition, for each gGN, by definition, put 



Lq = \ { max \^{t,y,v)\ + l) \ g G N, (38) 

teJ 



V G f/g+2 

and let L(-) G C(R'^; ]0, +oo[) be an arbitrary function such that 

Lq+i < L{^) < Lq whenever ^ G Sg, g G N (39) 
(for instance, L(-) given by 



^(0 



L2 if ^ G Hi 

/fe^^. + fefctVi ifeeH,, g>2, gGN 



tg— -ftg— 1 

is continuous and satisfies (jHEI))- 

For each (^, t, y)&E, let gGN be such that ^GHg. Then yEKg+i, and, by the construction 
of f/g, there exists v^^t,y^Uq such that |xp(^,t) — fp(t,y,v^^t,y)\ < ^- Since fp is continuous, 
from condition 2) of theorem 2.2, we get the existence of an interval I^^t,y =]t—de^,t,y, t~^(^^,t,y[, 
where 9^^t,y > 0, and a{^,t,y), p{C,,t,y) are numbers from ]0,|[, such that, for each 
rieB-s{^^^t,y){C)^ each se^^t,yr\J, and each zeBp(^^^t,y){y), we have: 

\ipiv^ s) - /p(-5, v^^t^y) I < 6q. (40) 

Choose an arbitrary g]0, 6*^^^ y[ such that 

rg,t,y <min{V2p(e,i^,Z/), ^-ti} (^ e HJ. (41) 

Let 6^^t,y{-,-) and r^^t^y(-,-), be the functions of R^'xR'' to R and T^^t,y C R^'xRxR'' be 
the open set that are given by 

e^,t,y{v,z) =t+T^,t,y-Lq+2\z-y\-A{T-h) me^xf^O, ^GS,; (42) 

r ir^-^i n 

^«,t,?;(^)^)='^-n,i,y+^g+2k-l/|+4(T-ti)max|0, ^ y) ~2 J ' 

= {(r/,s,z)GR^xRxR'=| r5,t,j,(r/, z)<s<%t,j,(?7, 2;)}. (44) 

From PT|) it follows that T^,t,y C B-s(^^^t^y){^))<I^^t,y^B-pi^^^t,y){y)-, and, therefore, for each 
{rj, s, z)ET^^t,y such that sGJ, we obtain (pHl : combining this with the inequalities 
^(^, t,y)<^, and p(^, t, ?/)<i, we get 

V(r/, t, z) G T^,t,y (\v-^\<\) A(\z-y\<^y (45) 



Then, for each (r/, s, z)ET^^t,y^ we get: 77 G i?ijg^-^(0). By the definition of 5g, this yeilds: 

V(r7,s,z) GT5,t,,f|(R'=xJxR'=) |i;p(r/, s) - /p(s, ^, t;^,^,,)! < ^(r^). (46) 
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Thus, we have constructed the family of pairs {(T^,t,y, 'v^^t,y)} t y)&EJ where each Tg,t,y is an 
open subset of R'^xRxR'' such that (jlUj) holds. 

For the open covering {T^,t,y}(^^ty)^E choose a countable locally finite subcovering 
{T^,,tr,yr}T=i of ^ follows. For g = 1, let {Tg,,^,y,}^LT' tie a finite subcovering se- 
lected from the open covering {T^,t,y} t y)eEi C'f the compact set Ei (in particular, we have 
{^r,tr,yr) & Ei, r = 1, ...,ri). Assume that, using the induction over gGN, for some gGN, 
we have already constructed a finite covering {T^r,tr,yrYr=iy of compact set Eg, such that 
{^r,tr,yr)&Eg, r=l, ...,rq. Then, from and from we obtain that the compact set 

-^<?+i \ ( U tr j/r) not cmpty. Select from its open covering {T^ t y} ^i 

r=l ' ' ' ' (C,i,?/)eS^+l\( U Ti.^,tr,yr) 

a finite subcovering {T^r,tr,yrYr=rq+i^ ^'^^ obtain the finite covering {T^r,tr,yrYr=i i of the 
compact set -Eg+i, such that {C,r,tr,yr)&Eg^i, r=l, r^+i. 

oo 

By the construction, for r>rg+i + l (gGN) we have {^r,tr,yr) ^ U (-^'g+m+i \ -E'g+m) ; 

m=l 

then, from we obtain T^^^tr,yr fl x R- x R-'^j = 0, and, therefore, 

n T^.^.^y^ = whenever r > r,+i + 1, g G N. (47) 

In particular, from this, we obtain that the covering {7"gr,tr,j/r}^ii of E is locally finite. To 
simplify the notation, by definition, put: 

Sr:=T^,,u,y,[]{R''xJxR'') and Vr:=v^,,tr,yr for every reN (48) 
Furthermore, for each ^(■)gC(R^xR^; J), and each AcR'^xR'^, we put by definition: 
^ei.),Ao = {(r/, ^) G R'^ X R X R^l s < e{r], z)}\ 
{{t], s, z) G R'^ X R X R'^I (s = e{7], z)) A ((?7, z) G Ag)} 

^oi.),Ao = {(r/, s, z) G R'^ X R X R^l s > e{r], z)}\ 
{{r], s, 2) G R'^ X R X R'^l (s = e{r], z)) A {{r], z) G Aq)). 
Let F be the system of all the sets given by 

where O(-), and 'i9(-) run through the set of all the functions of class C(R'^xR'^; J) such 
that, for all (^, 2)gR'=xR'=xR^ 

m,y)-ei^,z)\<LiO\y-z\ and m,y)-^i^, z)\<m\y-z\, 



and AqCR'^xR^ A^cR^xR^ run through the set of all subsets of R'^xR'^. 

First, note that, if Tj{-, ■), j=l, M, are some functions of R'^xR'^ to R such that 

G R'^ V?/ G R'^ V;^ G R'^ \T,i^,y)-T,i^,z)\<LiO\y-z\, J = 1,...,M, (49) 
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then, we obtain: 

VeGR'^ Vi/GR'= V^gR^ I max {r,(e,y)}- ma.x {rji^, z)}\ < 1(0 \y - z\, (50) 

j=l,...,M j=l,...,M 

W^eR'' WyeR' WzeK'^ \ min {r,(e,y)}- min {r^{^, z)}\ < m \y - z\. (51) 

j=l,...,M ]=!,.. .,M 

Therefore, it is easy to verify that F is a semiring of sets, i.e., (see. [HJ p. 51]) first, 0GF, 

second, for each S'gF, and each S"gF, we have S'f]S" G F, and, third, for every EgF, 

and every SiGF, if SiCS, then there exists a finite sequence C F of sets from r 

I 

such that S = IJ Sj, and Sjf^Ej = for all ij^j, {i,j}c{l, 

On the other hand, from (|42|) - (j44p . we obtain that, for each rGN, the set Sr can be 
represented as Sr = Se,,(.),-,,(.),A_^,A_ , where 

Qriv,z) = min{T, max{%,j^,j^,,(r/, 2), ti}} , (77,2;) G R'' x R'=; 

Tr{r],z) = max{ti, mm{T^^^tr,yr{'n, z), T}} , {rj^z) G R'' x R''; 

= {(r/, ^) G R'^ X R'^l (r^, ^) < T}; = {(r/, ^) G R^ x R'^I t, < n.,u,yM z)}. 

In addition, from (ji^ . and from we get 6.r(?7, -z)=ti, and r.r(?7, 2;)=T for \i] — > |, 
and for every z&R^. Hence, since (j49|l implies (j5n|l and (jSl}, from (j38|l . and from (j39|l . it 
follows that, for each rj&R^, each yGR'^, and each zeR^, we have: 

19^(77,?/) - e,.(r7,z)| < L(r7) and \Tr{r],y) - Tr{T], z)\ < L{r]) \y - z\. 

Thus, each set 5*^ (rGN) is an element of semiring F- 

Then, from (j47|) . from (j48|) . and from lemma 2 in [T^ p. 53], it follows that there 
exist a sequence {S/}^^-^ = {Se,{.),,?,{.),Ae,,Ai,j of sets from F and a strictly increasing 

Tq Iq 

sequence {/gj^^ C N such that: (Ai) for each gGN we have IJ 5"^.= |J (which implies 

r=l 1=1 

00 00 

U S/ = [J Sr); (A2) S;/ n Si"=0 for all I'^l", /'gN, T'gN; (A3) for each rGN, there exists 

1=1 r=l 

a finite set of indices P(r) cN such that Sr = IJ Then, using (Ai) and (A2), for each 
/gN we obtain that C |J Sr whenever lq+l<l<lq+i, (^GN, and C |J Sr whenever 

r=rq+l r=l 

l<l<li. Therefore, for each /gN, there exists r(/)GN such that T,iGSr{i), and, if l<l<h, 
then l<r(/)<ri, and if lq+l<l<lq+i (gGN), then r^+l < r(/) < rg+i. Taking into account 
and the inclusion C ^er(0'*r(i).yr(o' obtain: 

(Si(e)xJxR'=) = whenever ^GSg+i, gGN\{l}, /gN; (52) 

(5i(0xJxR'=) = whenever ^ G Si IJS2, / ^ {/'liti, / G N. (53) 

For each ^gR'^, let ^{C,) be the finite number of indices given by 

If:- "'^ri^J^'"''^' (54) 
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By definition, put: 

vi^,t,y) = Vr(i) whenever {^,t,y)EEi, IeN. (55) 

Then, from (jlH)), from (j^ . and from the inclusion C T^^^^.^,t,.^i),y^^iy we obtain: 

oo 

V(r/, s, 2;) G IJ S/ \xp{r],s)- fp{s,z,v{r],s,z))\<6{ri). (56) 
1=1 

Let us prove the following lemma. 

Lemma 3.1.1. 1) For each ^gR'^, there exist a unique z(^, ■)gC(J; R'^) such that 

^(e,T) = e, (57) 

a unique finite sequence of indices ={iyj}J^f C^{^) such that N{^) < 

Vp.-=/^Vj whenever fi^j , and a unique finite sequenceT=rl{^)>T2{^)>...>T^(^^^^{^)>T^(^^'j^^{^) = 

=ti such that: 

1.1) z{^,t) is defined and continuous at each tEJ\{Tl{^), r^^^^(^)}, and 
{^,t,z{^,t))eE and \xp{^,t)-fp{t,z{^,t),v{^,t,z{^,t)))\<6{0, whenever te J; (58) 

1.2) for each j=l, N{C,), we have: 

{^,t,zi^,t))eK, for all tG]r;+i(0,r;(0[, (59) 

z{^,t)=^it,zi^,t),vi^,t,z{^,t))) for all t G]7-_,i(0, r;(0[, (60) 

r;iO = e.,(e,^(e,r;(0)), r;+i(o = ^.,(e,^(^,^+i(0))- (ei) 

2) For each ^gR*^, and each /gN, let t\-^si{C,,t) and t\-^ti{C,,t) be given by 

si{^,t)=t-^i{^,z{^,t)), ti{^,t)=t-Qi{^,z{^,t)), whenever teJ, IeN (62) 
Then, for every .^gR'^, and every /gN, first, 

> si{^, t) - si{i, ^) > ^ whenever t>T, /gN, (63) 

--^ > ti{^, t) - ti{^, ^) > ^ whenever t>r, /gN, (64) 

for all teJ and teJ, and, second, there exist unique sf(,^)GJ and t;*(^)GJ such that 
si{^,s^{O)=0 and t,(e,tr(O)=0. Moreover, T=C^(0; ^*(0=C.(0=<_,(0, ^=2, iV(0; 

Proof of lemma 3.1.1. Choose and fix an arbitrary ^gR^. Choose gGN such that 
^GSq. By definition, put: Tq{^)=T, ri*(^)=T. Next, using the induction over zGN, we con- 
struct the desired t*(^) and z/j=z/j(^), and the trajectory t\-^z{^,t) on [r*(^),T] and prove 
the uniqueness of the construction. Throughout the proof of lemma 3.1.1, ^ is assumed to 
be fixed, and, therefore, we always write instead of 

For i=l, the construction is trivial: put z{^,t):=^ for tG[T, T] = [rj*(,^), Tq (,^)]. Then, 
by the definition of Kg and Eg (see (IS2I), (jHH|l . (j!?Hjl ). from the equality y{C,,T)=^, 



17 



we get: {C,,T,^) = {^,T, z{^,T))eE. Hence, from (|^. we get for i=l and for 

tG[r^*(^), Tq (^)] = [T, T]. Furthermore, for 2=1, and for each jGN such that l<j<i—l, condi- 
tions (j59|) - (j6ip hold by definition (there are p— 1=0 identities or inclusions to be satisfied). 
Finally, the uniqueness of ^^-*^(^,t) defined on [tq , r^^)] = {T} follows from (jHTj), and 
the uniqueness of Tq(^) and t*{^) follows from their definition. 

Assume that, for some iGN, we have already constructed a finite sequence of 
indices (if «=1, the sequence is empty by the induction hypothesis - see 

above) such that i^fij^i^j for all jj^fx and C — 1}, a finite sequence 

T=T^{^)=T^{^)>T^{^)>...>T*{^)>ti, and a trajectory t^z{^,t) defined on [t*{^),T] such 
that: dnH) holds, ^ holds whenever te[T*{^),T], and hold whenever l<j<i-l, 

jGN (again, for i=l, we deal with the empty set of conditions (fKn|) - (jF)T|) - see the induc- 
tion hypothesis). In addition, assume that we have proved the uniqueness of {h'jY'^ and 
{r*(^)}*^Q, and the uniqueness of such z{C^, ■) on [r*(^),T]. Finally, suppose we have proved 
that functions si{^, ■) and ti{^, •) defined by ^ for all te[T*{^),T] and /gN satisfy (Ol . 

for all t G [r*(^),T] and r G [r*(^),T] (again, for i=l, this is trivial: in this case, we 
get [r*(0,T] = [T,T] so that the set of {r,t} C [T,T] such that t>r is empty). If 7^*(0=^l, 
then, we put i =: A^(0 + 1; and note that, in this case, lemma 3.1.1 is proved because, from 
the definition of F, and from (jH^ . we obtain: 

si{^,T) > 0, ti{^,T) > 0, sKe,ii) < 0, ti{^,h) < 0, whenever /gN, 

and, therefore, from (j63|) . (j6l|l . we get the existence and uniqueness of (^)g J and t;*(,^)G J 
such that S;(^, s^(^)) = 0, ti{C,,t^{^)) = (/ G N). From the uniqueness, and from (jHH), we 
get: 

Therefore, it suffices to consider the case when r*(^)>ti. From the induc- 
tion hypothesis, we get {^,t*{^), z{^,t* EE; hence, there exists e>0 such that 
{C,,t*{^)—s,z{C,,t*{^)))eE for all sG]0,£]. Since all S; are mutually disjoint, and E C 

oo 

IJ S;, we obtain that there exist unique z/j=z/j(^)Gf2(^) and rG[ti,r*(^)[ such that 

{t}x]r,r;(0[x{2;(e,T^*(e))} C S,^, and r = ^9,^(e, ^(e, t;*(0)), r^O = e,,(e, ^(e, r;(0)). 
Consider the trajectory t\-^y{t,T*{C,), z{^,t* Vr(u,)) (which is defined on the maximal 
possible interval of time according to our notation). It is one or the other: either it is con- 
tained in -Bd,(0) for all t from its domain, and, then, it is well defined for all tG[ti, r*(^)], 
or there exists sG]ti,r*(^)] such that this trajectory is defined for all tG[s,r*(^)], and 
y{s,T*{^), z{C,,T*{^)),Vr(ui))^B(iq{0). In the first case, by definition, put s:=ti, and, in the 
second one, put: 

s := sup{t G [ti,r;(0[| |2/(t, <(0, ^(e, ^*(0), I = 

(since y{- ,t*{C^), z{C,,T*{^)),Vr{ui)) is continuous, we deal with the supremum of a compact 
subset of R, and \y{s, t*{C,), z{^, T(*(0)) '^r{ui)) \ = dg). In both cases, s satisfies the following 
conditions: 

vt e [s,T:m l/(^,7^*(0,^(e,r;(0),^;.(^,)) e (65) 
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{^,s,y(s,T:{0,4^,r:{0),Vriu^))) i intS,^. (66) 
Let us prove that the functions s/(-, ■) and t;(-, ■), /gN, defined by 

sz(e,t)=t-^/(e,z/(t,r;(0,^(e,r;(0),^r(..))), tKe,t)=t-ez(e,i/(t,r;(o,^(e,r;(0),^r(..))) 

satisfy the conditions: 

VrG[^,r;(0] WG]r,r;(0] V/ G N f ^i^^ > ^,(e, t) - ^K^, r) > ^ V 



A (^^^ > tKe,t) -tKe,r) > ^) . (67) 

Indeed, since all are elements of r, from (jU^ . and from the definition of F, 

it follows that, for every /gN, every rG[s, r*(^)], and every t G]r, r*(,^)], we obtain 

1^/ (e,i/(t,r;(0,^(e,r;(0),^.(..))) -^^ (e,i/(r,r;(o,^(e,<(0),^r.(..))) I < 

< m\y (t, 7;*(o, Ai. ^.(^o) - ^(e, ^*(0), ^.(^.)) i < 

t 

f t — T 

T 

From this, we get the first group of inequalities (|U7j) for functions Si(-, ■). The proof of the 
the inequalities (jU7|) for t;(-, ■) is similar. 

Note that, by the construction, t^.{C,, r*(^))=0, and Si^.{^, r*(^))>0. From (jHZI), we get, 
in particular, that t^.{^, ■) and Sj^,(^, ■) are strictly increasing functions on [s, r*(^)]; hence 
t^. {^,s)<0. Then, the inequality Sy-(^, s)>0 is impossible, because it implies 

{^,yis,T:iO,4^,r:iO),Vr(u.))) <s < Q..^ (e,l/(l,r;(0,^(e,r;(0),^r(..))) , 

which contradicts (jHS))- Therefore SuX^,s) < 0. Then, since s^X^^ ") is strictly increasing and 
continuous on \s,t* there exists a unique Tj+i(0^[^) such that s,y-{^, T*_^_l{^))=0, 
and such that for each tE]T*_^i{C,) , t*(^)[ we have t,^.{C,, t)<0<s,^.(^, t), i.e., (by the definition 
of sz(^, ■) and tz(^, ■)) 

Vt G]7^^i(0,r;(0[ (e,t,y(t,r;(0,^(e,T;(0),^K-,))) e intS,,; (68) 

tUO = k (e,2/(^;i(0,r;(o,^(e,^*(0),^.(.,))) ' 

= <S>u. (e,2/(r;(0,T,*(0,^(e,r*(0),^.(..))) • (69) 
Define the extension of z{^, ■) to [t*j^-^^{^),T] by 

z(e,t) = i/(t,r;(0,^(e,^*(0),^r(..)) whenever t G [rUO,r*iO]- (70) 

Then, from ()68|) and ()69p . we obtain that ()59|) - (jM|) hold not only for l<j<i~l but for all 
j=l, Furthermore, from (|68p . (|7(J|) . (j56p . and from the condition 

|ip(e,t) - Uit,zi^,t),vi^,t,zi^,t)))\ < 5(0 whenever t G [r;(0,T], 
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(which holds by the induction hypothesis) we get 

\xpi^,t) - fp{t,z{^,t),v{^,t,z{^,tm < 5(0 whenever t e [r;Vi(0,^]- 

By the construction, ty-^z{^, t) is the trajectory, of (j27j), defined on [t*^i(05 T] by the initial 
condition z{^, T)=^ and by the control t\-^fp{t, z{C,, t),v{^, t, z{C,, t))); therefore, from lemma 
3.3, we obtain that z{C,,t)&Kg for all tE[T*_^_i{C,),T]; hence, by the induction hypothesis, 
{^,t,z{^,t)) G E whenever t G [r*_^i{0,T]. 

Thus, the trajectory z{C,,-) (which is now defined on [t*^-i^{^),T]) satisfies for all 
tE[T*j^-^^{^),T]. In addition, by the induction hypothesis, (j37|) holds, and, from and ^7^ . 
it follows that conditions §^ hold for all te[T*_^^{O^T] and all rG[r*+i(0, ^1- Hence, 
from we get Vi^Vj whenever j=l,...,i— 1. (Because, for each j=l,...,i— 1, and each 
tG]7:;+i(0,T*(0[, we have: s,^(e,t)<0, i.e., {i,t,z{i,t)) ^ E,^, but {i,t,z{i,t)) G 

Let us prove that, Ui=Ui{^), T*j^i{i), and the trajectory t^z{^,t) for t^[T*j^i{i) , t~* {^)] 
are uniquely determined by this procedure. Since, by the induction hypothesis, {z/j}*^^, 
{r*(0}j=o' for tG[r*(0,r] are already uniquely determined, this means the 

uniqueness of {T^j}]^^, {r*(0}jil), and z(^,t) for all te[T*^^{0 ,T]. 

Assume that there exist tG[ti, 7^*(0[, 5(^, ■) e C{'^,T*{C)\^^B]'){^C^{]t,r*{C)[,^^), and 
z>GN such that 

(e,i,5(e,i))eS^ whenever ^G]t,T^*(0[; (71) 

^5(e,t) = ^(t,5(e,t),t;(e,t,5(e,t))) whenever tG]t,T;*(0[; (72) 

5(e,^*(0) = ^(^,<(0); (73) 

M^rz{^rt)) = t. (74) 

Let us prove that, from (f7T|) - (f7i|) . it follows that i>=z/j, t=r*,_i(0) and 5(^, t)=2;(^, t) 
whenever t G [t*+i(0) Indeed, for each tG[t, r*(0] we obtain that 

~z{i,t) = z{i,T*{i))- [ if{s,z{^,s),v{^,s,z{^,s)))ds; 



in addition, from (j^^ . (j^Hj) . and from ()71|) . we obtain that u G f^(0? which implies 
5(,^, t)G-Bdg(O) for all tG[t, r*(0]; hence, (by the same argument as for the proof of (jUTjl ) 
from (f7T|) . and from the definition of {S/}^^ and F, we obtain that, for every t G [t, t*(0] 
and every r G]t, t], 

1^9., (e, 5(e, t))-^.X^, 5(e, r))|<^, |e.,(e, 5(e, t))-Q,XC, ^))l<^- 
Therefore, the continuous functions t\^s^^{C,,t) and tt— >t,,.(^, t) given by 

5,,(e,t) = t - ^uX^,z{U)), UXi.t) = t - e,,(e,5(e,t)), for all t G [^,7^*(0] 

are strictly increasing on [t, t*(0]- From (f7H|) . it follows that Si,.(^, r*(O)>0, and 
hence there exists sG]t, r*(0[ such that, for each t G [s, r*(0[, we have 
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tui{^,t)<0<Su.{^,t), i.e., {C,,t, z{^,t))EmtT,i,^. Since z{^,-) is continuous, there exists rG[t, s[ 
such that, for each t G]r, s], we have z{^,t)) G intS^,^. By definition, put: 

T* = inf{r G [I S[ I Vt G]r, S] (e, t, t)) e intE.J. 

From the definition of r*, it follows that, for each t G]r*,5], we get the inclusion 
t, z{C,,t)) EmtT,^.. This inclusion holds for all tG[5, r*(^)[ as well (by the definition of 
s); hence, for each t G]r*,r*(^)[, we obtain v{^,t, z{C^,t))=Vr[ui), i-e., taking into account 
m and (HSl), we get t)=2/(t, r*(0, ^(e, T^*(0), ^oi all tG[r*,r*(0]. From this, 

from ()71|) . and from the fact that all S;, / G N, are mutually disjoint, we get 9 = uj. 

Let us prove that T*=T*_^^{^)=t. First, we prove that T*=r*^i(0- Indeed, if T*<r*_^i(0, 
then, by the above, the point {^,T*_^,^{0, z{^,r*+i{0)) = ^(^, belongs 

to dT,^., which contradicts the definition of r*. If T*_^i{0<'^*<'^iiOy then, since ■) 
and Si^X^, ■) are strictly increasing on [r*^i(0, ^*(0]5 we get t^X^, t*)<0<s^X^, t*), i.e., the 
point (^, r*, z{C,, t*)) = (^, r*, r*)) belongs to intS,^.. Then, from (fTIj) . from the equality 
z>=z/j, and from the definition of r* (r* G [t, s]) it follows that t<T*. Therefore, since ■) 
is continuous, there exists 9*e[ t, t*[ such that, for each tE]9*, r*], and, moreover, for each 
te]9*,s], we get (^, t, z{^, t))GintE,,.. This contradicts the definition of r*. Thus, r*=r*^^(^), 
as desired. 

Second, we prove that T*^i{^)=r*=t. Assume the converse, then from the definition of 
r*, and from the equality t*_,_i(0 = (which is proved) we get t<r*=r*_^^(,^). Therefore, 
having proved that s^^{^, ■) and i^^i^, ■) are strictly increasing on |I, r*(^)], and z/ = Ui, from 
jZH), we get: 

rUO > AA^,z{^,rU,m =^uA^,m,r*)) =^.A^,z{^,T*)) == ^.,(e, ^(e, ^Vi(O))- 

This contradicts the definition of t*^i{^). 

Thus, it is proven that t=T*_^_^{C,)=T* , u=i'i, and z{S,,t)=z{S,,t) whenever t G 
(0>^*(0]> as desired. 

To this end, we construct the uniquely determined sequences {t*(0}) and 
the trajectory t^z{^,t) on [t* {C) , T*_-y{^)] by induction over i = 1,2,3, .... It is one or the 
other: either, for some i=:N{^), we get t*_^i{^)=ti, and, then, lemma 3.1.1 is proved, or 
we obtain an infinite sequence {t*(^)} such that, for each zgN we have: t*(^) > ti. But 
the second case is impossible, because, by the construction, each belongs to the finite 
set fl{^), and whenever i^j. Thus, for the obtained sequence of t*(^), there exists 

i=N{^) + l<|f2(^)| such that r*(^)=ti. The proof of lemma 3.1.1 is complete. 

Define the desired family of controls {f (^, OlgeR'^ 

v{^,t) = v{^,t,z{^,t)) whenever t G J, ^ G R*". (75) 

Let us prove that this family satisfies conditions 1)- 3) of lemma 3.4. 

From lemma 3.1.1 (see (jSTj), (j^ . and (jHO))) it follows that {^^(^, Ol^gRfe satisfies con- 
dition 2) of lemma 3.4. Let M(-) be an arbitrary function of class C(R'^; ]0, +oo[) such 
that M(^) > No{q + 3) + 1 for every ^gR'', where gGZ+ is such that ^gS^+i, and No{q) 
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(geN) is defined in (jHTj) . Then, from tlie definition of (see it follows that we 

obtain ^^(i) G t/g+3 for all /Gf2(^); hence \vr(i)\<M{^), and, therefore, {"f^l^, OI^gr*: satisfies 
condition 3) of lemma 3.4. To conclude the proof of lemma 3.4, it suffices to show that 
{■^(^5 OlggRfc satisfies condition 1). 

Take any ^gR'^, and let {i^i=i^iiO}fJi^ be the sequence, of indices, defined by ^ in 
lemma 3.1.1. From now on, up to the very end of the proof of lemma 3.4, ^ is assumed to 
be fixed, and, therefore, we write z/j instead of z/j(^). From lemma 3.1.1, it follows that to 
prove that 

II ^'(^r) -^^(^,-)|Ili(J;r-p+i) ^ asr]^^ (76) 

it suffices to prove that all the fuctions Tj^sl.irj) and Tj^^tl.irj) , where 2G{1, A^(^)}, are 
continuous at ^. Indeed, combining this with the inequalities s*^(,^)<t*. (,^), we get the exis- 
tence of 5 > such that, for each rjEBj^C,), and each zG{1, A^(^)}, we have: sl.{ri)<tl_{ri). 
Then, from we obtain that, for each r]EB-g{C,), and each 2G{1, A^(^)}, the in- 

clusion {rj, t, z{ri,t)) EinfE^^ holds if and only if sl^{ri)<t<tl,{ri); hence 

v{r],t) =Vr^u,) whenever v^B-g{^), sl^{r])<t<tl^{ri), i = 1, N{^). 

Then, since s*. (■) and t^. (■) are continuous at ^, and {v{ri, OljjgRfc satisfies condition 3) of 
lemma 3.4, we get (f7B|) . 

For 1^0=0 G Z+, by definiton, put: 

slM = KM = rSiv) = r^iv) = T, {v, z)eK'x K'. 

Let us prove by induction on iG{0, 1, A^(,^)} that ri\-^tl_{ri) , Tj\-^ s*j^.{vi) , rj\^z{rj,tl_{vi)), 
and 7] I— i> z{iri, s*^_{ri)) are continuous at ^gR'^. For i=0 the statement is trivial; assume that 
it is proven for some iG{0, 1, A^(^)— 1}. 

First, let us prove that 77 ^ Ki+iiv) is continuous at ^. By definition, put 
'&-=s^,+A^,T*^i{0), i-e-, (see lemma 3.1.1) 

-d,^^, (e, z{i, r*,i(0)) = (e, z{i, r*,i(0)) - ^9.,^, (e, z{i, r:^,{i))) > (77) 

Take any eGjO, |]. Since 'i9j,-^-^(-, ■), 6i,^^j(-,-), and 9j,^(-,-) are continuous on 

R'^xR'^, and s*. (■) is continuous at ^, there exist 61 > and ^2 > such that 

KMy)-^-^A^^^i^^<+iiO))\ <i<^ fo^ all 

(r/,Z/)G%(Oxi?s.(^(e,^+i(0)), Je{^,^ + l}■, (78) 

- Qu,{^,z{^,rUO))\ < I < ^ for all 
iv,y)eB-s^iO^B-,^izi^,T:^,m, Je{^,^ + l}■, (79) 
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for all {v,y) e 5,^(0 X B,^{zi^,T*^,m- (80) 
Since S^^ f] S^,^, = 0, from we get: 

for all iv,y) E x B-,^izi^,T:^,m (81) 

On the other hand, since r]\-^z{ri, sl_{ri)) is continuous at C,, and T*_^i{0=KiiO^ ob" 
tain that there exists 5g]0, such that, for each riEBj(^), we have z{r], sl.{r])) G 
^52(^(^'^i+i(0))- From this, and from (jHU, and we obtain: 

Combining this with (jHS)), (|MI), we obtain: 

i.e., (?7, s*.(?7)— £, 2;(?7, s*.(?7)— £:)) GintSy-^^. By lemma 3.1.1, functions s^.^^^r],-) and 
tui+iiVy ■) strictly increasing; hence, for each r]EBj{^), we have Ci+i(^)^['5^i(^)~^5 KSv)]- 
Since e > 0, is chosen arbitrarely, we get: lim|t* (r7)— 3*^(77) |=0; but, by the induction 

hypothesis, \ims* {r]) = s* {^) = r*^i(0 = hence t* {■) is continuous at ^, as 

desired. 

The fact that V^^{v>K,+iiv)) is continuous at ^ follows from the estimates 

\4v,tujv))-4^,t:^jm < \^iv,tujv))-z{v,s:sv))\+ 

+ \z{T],slXri))- z{i,slXi))\<\ / ^{s,z{r],s),v{T],s,z{T],s)))ds\ + 



+ |z(r/,<(r/)) 4(0)1 <^IC.+,(^)-<(^)l + 

+ |^(r/,.;(r/))-;.(e,<(0)l, 
from the equalities t^-^^(0 = '^i^i(0 = '^j*+i(05 from the induction hypothesis, and from the 
continuity of V^Ki+i iv) ^. 

To prove that s*.^^(-) is continuous at ^, first note, that, for some pi > 0, some e > 0, 
and some > 0, the function t(-, -, -, ■) given by i{r], t, r, ?/°) = t-^^^^^ {rj, y{t, r, y^, Vr(u,+-,))) 
is well defined, continuous and stictly increasing w.r.t. t for all {ri,t,T,y^) in 

b-pAO X [4^,(0-^, r;Vi(0+^] X Ki(0-^, r;Vi(0+^] x 5^,(^(e,Tv;i(0)) 



(the proof is similar to that of (EZD). Then, since = i i^^, s:^JO,t:^^,iO, 4^,t:^J0) 
from the implicit function theorem, it follows that there exists a unique function [i], r, y) 
s{ri, T, y) that is continuous on the set 

0:=%(0 X [r;Vi(0-^~, r*,i(0+5l x i?^,(z(e, 7^!,i(0)), 
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for some pi G]0,Pj], i=l,2, e g]0,£:], and is such that, for every {ri,T,y'^)EU, we have: 

Then, by the construction, for each r] from some neighborhood of .^GR^, we get s^.^^^rj) = 
^iv^Ki+iiv)^ ^iv^Ki+iiv)))^ and, therefore, having proved that r] i— > tl^^^irj) and rj i— >• 
-2(^5 s^re continuous at ^, we obtain that is continuous at ^ as welL 

Finally, the fact that r] z{ri, Ki+iiv)) is continuous at ^, now follows from the conti- 
nuity of tl,^_^{-) and 1] z{ri,tl^^^{ri)) at ^, from the equality 

and from theorem on the continuous dependence of the solution of the Cauchy problem on 
the initial condition. 

Thus, it is proven by induction over iG{0, 1, A^(0} that (in particular) all tl^{-) and 
are continuous at ^. The proof of lemma 3.4 is complete. 

Next, we complete the proof of theorem 2.2 as follows. First, for each ^gR*^, and for 
the segment [ti,ti+(r{^)], we get an appropriate approximation of the original collection of 
controls {fA(^,-)}A by another collection of sufficiently smooth controls {usi,x{C,, ■)}x that 
satisfy the desired boundary conditions (jH2I) (see also condition 5) of theorem 2.2), and, 
together with their derivatives w.r.t. t, continuously depend on ^gR*^ and tG[ti, ti+(T(^)] 
(lemmas 3.5, 3.6). Second, (lemmas 3.7, 3.8) we do the same for each f (^, ■) (^gR^) 
constructed in lemma 3.4, and for the segment [ti+a{C,),T], and obtain a smooth control 
VAii^, P, ■)■ Finally, for each ^gR'^, and each /3gR™*'+S we find the desired control that 
satisfies conditions 5), 6) of theorem 2.2 among all concatenations of fAi(^,/?, ■) with all 
possible usi,x{C,,-), AG-B£i(^)(0) (see (jHS)) Then, condition 4) of theorem 2.2 will follow 
directly from our construction. 

Lemma 3.5. For each 5i(-)gC(R^; ]0, +oo[), there exists a family of controls 
{m5i(^, Ol^eRfc sucii that, for each ^GR'', we have us^{^, ■) G C^([ti, ti+cr(^)]; R™p+i), and 

1) Functions us^{-,-) and -^us^i-,-) are continuous everywhere on {(^, t)GR'^x J| ti < 

t < h+a{0}- 

2) For each ^gR*^, we have: 

M5i(^,ti) = M5i(^,ti) = 2p+i; (82) 

max M^,t) - 0(t,|/(e,t),Xp(e,t))| < 5i(0- (83) 
te[ti,ti+<7(C)] 

If cr(-) is a constant function, i.e., ti+a{^)=t2 for some ^2 &]ti, +oo[, and for all ■CgR'^, 
then the proof is the same as the proof of lemma 3.5 from JH], and follows from lemma 
4.2. If (t(-) is not a constant function, then, taking an arbitrary t2>ti, and introducing the 
linear transformation of time t{^, s) = ti + ^^7^37^, sG[ti, ^2], ^SR'^, we reduce the problem 
to the case of constant cr{-), and complete the proof of lemma 3.5. 
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To each 5i(-)gC(R^; ]0, +oo[) assign a family {usj^{C,, OlgeR*^' '^^ controls, obtained from 
lemma 3.5, and, then, for every A=(Al,...,Afc)^GR^ and every ^gR'^, define the control 
^5i,a(^, ■) on [ti,ti+cr(0] by 

k 

us,,xi^,t)=us,i^,t)+J2>'j^ji^^^)^ whenever tG[ti,ti+a(0]. (84) 

For each 5i(-)gC(R'^; ]0, +oo[) define the family of maps {<l5j({, Ol^eR*^ R-*^ to R'^ as 
follows: for each ^gR^, and each AgR'^ such that ti^y(t,ti,y* ,usi^x{^, ■)) is defined for all 
tG[ti,ti+a(0], by definition, put: ^sA^, ^)-=y{ti+(^{0^ti,y*,us,,x{^, ■))■ 

Lemma 3.6. There exists a function Si{-) G C(R'^; ]0, +cx3[) such that the following 
conditions hold: 

1) For each (^, A)Gni:={(e, A)gR'=xR'=| AG5,,(g)(0)}, t^yit,t,,y*,us„x{^, ■)) is de- 
fined for all tE[ti,ti+a{^)], and, therefore, ^Si{^, ^) is well defined. 

2) For each ^gR'^, the map Ai— (^, A) is differentiable for all AGi?£-^(^)(0), and the 

maps (e,A)^<l5,(^,A), and A)^-^^(^, A) are of classes C(ni; R'^) and C(ni; R'^^'^) 
respectively. 

3) For each (^, A)Gni, we have: 

|$,,(e,A)-$(e,A)|<^, and || ^(e. A) - A) ||< p. (85) 

Again, if, for some t2>ti, we have o'{i)=t2 whenever ^gR^, then, the proof of lemma 3.6 
is the same as for lemma 3.6 in [18,. If cr(-) is not a constant function, then, taking some 
t2>ti, we easily reduce the proof to the case of constant a{-) after the linear transformation 
of time t=t(^,s)=ti + ^^|^, se[ti,t2], ^GR^ 

Let 5i(-) G C(R'^; ]0, +oo[) be chosen from lemma 3.6. 

Lemma 3.7. For each function Ai(-, ■)gC(R'^xR™'''+^; ]0, +C)o[), there exists a family 
{'WAi(^)/3, ■)}(5 /3)eR''xR'"p+i controls of class C^{J; IV^p+^) such that: 

1) The map P)^vaA^, P, ■) is of class CiR''xR'^^+';C\J;R"'^+')). 

2) For each (^, /5)gR^xR'^p+i, we have: 

VA, (e, T)=(3; VA, (e, /5, ti+a{0)=us, ti+a{0), va, t,+a{0)=U5, ti+a{0); 

(86) 

II VA,{^,P,-)-v{^,-) IL,(J;r™.+i) < Ai(e,/5); (87) 
II VA,{^,Pr) llc(j;R">+i) < 2max{|/?|, M^,ti+a{0)\, M(e)}+1, (88) 
where M(-) is defined in lemma 3.4. 

The proof of lemma 3.7 is based on lemma 4.2 and is similar to the proof of lemma 3.5 
from jl8j . 

To each Ai(-, ■)GC(R''xR'"f+i; ]0, +oo[), we assign a family {vai{C, P, ■)}(5,/3)eR'=xR'>+i ' 
of controls, obtained from lemma 3.7. Then the following lemma holds. 

Lemma 3.8. There exists a function Ai(-, ■)gC(R'^xR'^p+1; ]0, +cxd[) that, for 

each (^, /3)gR''xR™'p+i, the trajectory t\-^y{t, T, ^, va^C., P, ■)) is defined for all teJ, and 

\y{t,T,^,VA,{^,P,-))-y{t,T,^,v{^,-))\<-^ whenever t^J, (e, /?)gR*^xR'"-+^ (89) 
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The proof of lemma 3.8 follows from standard arguments based on the Gronwall-Bellman 
lemma. 

Let Ai(-,-) be chosen from lemma 3.8. From lemmas 3.3 and 3.4, we obtain that 
|y(ti+a(^),T,^,w(^, ■))-$(^,0)|<^ whenever ^gR^ then, using we obtain that 

|y(ti+cr(O,T,e,t;Ai(e,/3,-))-$(e,0)|<^ whenever (e, /3)gR^xR-^+^ (90) 

In addition, from condition 3) of lemma 3.6, from (see lemma 3.2), from the definition 
of p, and from lemma 4.3, we obtain that, for each .^gR'^, the maps $(^, ■) and $5i(^, ■) are 
diffeomorphisms of i?ej(^)(0) onto $(,^, -Be-^(^)(0)) and onto <l'5^(,^, i?e-^(^)(0)) respectively. For 
every ^gR'^, by $~^(,^, ■) we denote the diffeomorphism (of $(,^, i?e-^(5)(0)) onto i?£^(^)(0)) 
that is inverse to $(.^, ■). Then, from lemma 3.2, we obtain that the map ri\-^^Si v)) 
is well defined and continuous at each r7Gi?e2(g)($(^, 0)). Furthermore, from (jHH|l . we get 
\r] — ^Sii^,^~^{^,v))\ < whenever ?7Gi?e2(5)($(^, 0)). Therefore, using lemma 4.4, we 
get -6 3^2(0 (^(^, 0)) C <l5,(^, 5e,(5)(0)) for all ^GR''. From this, and from ^U^j, we obtain 

4 

that, for each (^, /3)GR^xR'"f+i, there exists a unique X*{^, f3)eBs-^((){0) such that 

K (e, A*(e, P)) = yih+a{0,T, e, v^,i^, P, ■)). (91) 

Since family {^^Ai(^5 Z^, ■)}(§ /3)eRfcxR™p+i satisfies condition 1) of lemma 3.7, the map 
{^,P)\-^y(ti+a{C,),T,^,VA-i_{^,P,-)) is of class C(R''xR™'p+i; R^); hence, using condition 
2) of lemma 3.6 and the implicit function theorem, we obtain that the map (^, l3)^X*{^, (3) 
is of class C(R'= x R^j'+i; R'^). 

For each (^, /3)gR^xR'"p+i, let '0(g^^)(-) be the control given by 

_ J ^5i,A*(€,/3)(^'^) if h<t<h + (t(0 , . 

y va^ (^, P, t) if ti + o-(^) <t<T. 

It is clear that the family {'0(5,/3)(-)}(g /3)eRfcxR™p+i defined by satisfies conditions 
4)-6) of theorem 2.2. Indeed, condition 6) follows from (PT|) . (jU^ . and from the definition of 
<l>5^(-, ■). Condition 4) follows from (j86p . (j84j) . from condition 1) of lemma 3.7, from condition 
1) of lemma 3.5, from (j^Uj) . from (PT|l . and from the fact that A*(-, ■) is continuous. Finally, 
condition 5) follows from (jH^ (see lemma 3.5), from (jHBj) (see lemma 3.7), and from ()21|) . 
This completes the proof of theorem 2.2 as well as the proofs of theorems 2.1, and 1.1-1.3. 

4. Appendix. 

Lemma 4.1. Consider a family of control systems 



i+l 

Zi{t) = Aij{^,t)zj{t), z=l,...,p-l; 
i=i 

Zp{t) = £ Apj{^,t)zj{t) + App+i{^,t)w{t), 



te[t^,t^+a{0] (93) 



where ^gR^ is the parameter of the family, cr(-) is a function of class C(R^; ]0; +cxd[), each 
Aij{^, t) is a matrix of dimension miXrrij (i=l, ■■■,P', J=l, ^+1 ), wGR™''+^ is the control, 
{zi, ...,ZpfeK''=K"''+ is the state, and ZieK"'% i=l, ...,p. 
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Assume that all Aij{-, ■) are continuous on D := {(^,t)GR^xR| ti<t<ti+a{^)}. Sup- 
pose that, for each i=l, ...,p, we have mi<mi^i, and there exist numbers ji<j2<---<jmi in 
{l,...,mj+i} such that the columns a^^j_^^ (■,■),..., a^7+i(' 5 ') 5 of matrix Aii^i{-, ■), numbered 
byju jm, satisfy the condition det [af^+i t), a^7|i(^, t)] 7^ for all {^,t)eD. 

Then, for each z'^eH'', and each /xGN, there exists a family of controls {w{C,, OI^grjv 
such that 

1 ) For each t)eD, and each 1=0, 1..., /i, there exist |f t) and |f (-, ■)eC{D; R"^f+i), 
(/=0,l,...,/i). 

2) For each ^gR^, the control w{C,, ■) steers OgR*^ into in time [ti, ti+o"(^)] w.r.t. 

3) For each ^GR^, we have: ti)=|f (e, ti+a(0)=OGR'"-+S /=0, 1, 

If (t(-) is a constant function, i.e., [ti,ti+a{^)] = [ti,t2] for some t2>ti and for all 
^ G R^, then, the proof of lemma 4.1 is similar to the proof of lemma 3.1 in ^H] and is 
based on the same construction as in theorem 1 (sect. 2) of J7j. If a{-) is not a constant 
function, then, taking some arbitrary t2>ti, and introducing the linear transformation of 
time t{^, s) = ti + ^^^r^^, sGfti, ^2], ^^R^, we reduce the problem to the case of constant 

Lemma 4.2. Let X and Y be linear normed spaces equipped with norms \\ ■ \\x and 
II ■ II y respectively. Assume that Y C X, and Y is dense in X w.r.t. \\ ■ \\x ■ Suppose that 
V ^ fiv) ^'s of class C(R^; X), where G N. Then: 

A) For each p > there exists a map r] ^-^ f{r]) of class C(R^; Y) such that for every 
7] G R^ we have: 

\\f{v)-f{v)\\x<P- (94) 

B) For each function rj \—>- p{r]) of class C(R^; ]0, +cxo[) there exists a map rj \—>- g{r]) of 
class C(R^; Y) such that for every t] G R^ we have: 

W fiv) - giv) \\x < Piv)- (95) 

Proof of lemma 4.2. A). To each 77 G R^ assign an open ball 5^ with the center at 
r] G R^ such that for each fj G B^i we have: || /(rj) — /(r/) ||^ < |. Let {v5i(-)}i^i be the 
partition of unity corresponding to the family of open sets {Br,}^^^N, which covers R^; 
i.e., |H21 P- 66], {v5j(-)}iSi is a sequence of functions, of class C°°(R^; R), having compact 
supports such that the following conditions hold: 

1) {supp is a locally finite covering of R^ (in the sense that each compact set 
in R^ has the nonempty intersection with only a finite number of the supports), and for 
each z G N and each 77 G R'^ we have: < fi{ri) < 1; 

2) For each z G N there exists rji G R^ such that supp (pi{-) C Bfj-; 

3) For each r] G R^ we have: X^i^i Viiv) = 1- 

(In condition 3), for each fixed t] the sum is finite due to 1)). For each i G N fix ?/j G F 

00 

such that II Hi — firji) \\x < f - Then, the map rj firf) = J2 fi{v)yi satisfies Indeed, 

i=l 
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using conditions l)-3), we obtain: 

oo oo oo 

II Kv) - fiv) \\x=\\ '^f^{v)y^ - C^v>i{v))f{v) \\x=\\ '^fiiv){yi - fiv)) \\x< 

i=l 1=1 1=1 

oo oo 

< Y,v^{r]) II 2/. - fmx + ^(^^) - ^(^) llx < f + f = 

1=1 i=l 

The fact that the map rj \—>- firf) is of class C{RJ^\Y) follows from the inclusion € 
C°°(R^; R) and from 1). A) is now proven. 

Let us prove B). For each G N, put: pk = min p{r]). Then, from A), it follows that 

\\T]\\<k 

for each /c G N there exists a map r] \—>- fk{fl) of class C(R^; Y) such that for each rj G R^ 
we have: || fkiff) — /(^)|lx ^ Pk- Let r] i-^ g{ri) be the map of R^ to Y given by 

g{r]) = {k- Ivl) fkiv) + (1 - A; + IvDIk+iiv), whenever k - 1 < \r]\ < k, k eN. 

Then rj i— ^(?^) is of class C(R^; Y) and satisfies The proof of lemma 4.2 is complete. 

Lemma 4.3. Assume that B C R is a convex open set, andF{-) G C\B; R*^) satisGes 
the condition: for each Aq G -B the matrix §f (Aq) is positive definite. Then, A i— > F{X) is a 
diffeomorphism of B onto F{B). 

Proof of lemma 4.3. Take any Ai G -B and any A2 G -B such that Ai 7^ A2. It is 
sufficient to prove that (-F(Ai) — F{\2), Xi — X2) 7^ 0, (where (-, ■) is the scalar product 
in R'^) which implies F{\i) 7^ F{\2). Then, from the implicit function theorem, we will 
obtain that is of class C^{F{B); R'^). From the assumptions it follows that 

(F(Ai)-F(A2), Ai-A2) = (F(A2 + ^^(Ai-A2))-F(A2), Ai-A2)|^=^ = 
1 

= y"(|^(A2 + ^(Ai-A2))(Ai-A2), \i-\2)de>0, 


which completes the proof of the lemma. 

Lemma 4.4. Let /(■) be a continuous map of B = {x E R"| \x — < r} to R", 
where r > 0. Assume that there exists e g]0, r[ such that \f{x) — x\ < r — e for all x E B. 
Then, each point z G R" such that \z — x'^\ < e belongs to the image of B under /, i.e., 
there exists x* E B such that f{x*) = z. 

The lemma follows from the Brouwer fixed point theorem. The proof is given in [221 
p. 276- 277]. 
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